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(57) Abstract 

In a meawd and a de- 
vice for partial encryption and 
pjogressive transmission of im- 
ages, a fast section of the im- 
Se file Ucompiesscd at reduced 

Quality without deaypuon. and 
ale^nd section of the image 
fileisencwt«l..U«sh^mg 
access to appropriate decryption 
kevwotds can decrypt this sec- 
S^r^on. Tbe first s«*on 
together with the decrypted sa- 
^d section can then beviewKl 

as a full quality image. The stw- 
age space lequiied for stonng the 

first and section togethw is «- 
sTntially the same as the stor- 
age space tequiied for storing 
A^uiTenayptedMlq.^^"^- 
aee By using ths niediod and 
divice as described heiein stor- 
aee and bandwidth requuements 
partially encrypted images ;s 
reduced. Furthermore, object 
based composition and proceM- 

HHHSFioi«n.en«yp.a..o.inaiob..canbede«.... 




Low . 

Quality 
Image 



Medium r 
Quality 
Image j 



High Quality 
Image 



restored in the compressed domain. 



Codes used to identify 



FOR THE PURPOSES 
States party to the per on dK front 



OP INFORMATION ONLY 



pages 



of pamphtets publishing inten«tianal applications under Uie PCT. 



AM 
AT 
AU 

AZ 

BA 

BB 

BB 

BF 

BG 

BJ 

BR 

BY 

CA 

CF 

CG 

CH 

a 

CM 
CN 

OJ 

CZr 

DE 
DK 



Albania 

Atmcnia 

Anstra 

Australia 

AzertMujan 

BosnU and HcrxegovnM 
Baibados 

BwkitiaPwo 
Bulgaria 
Benin 
Biszn 



Canada 

Ceacil Afifican Republic 

Congo 

Switicrland 

COic d' I voire 

Cameroon 

China 

Cuba 

Cicch RcpuWic 
Gtrnuoy 
Denmaric 
Estonia 



E5 

FI 

FR 

OA 

GB 

GB 

GH 

CN 

OR 

HU 

IE 

IL 

IS 

rr 
s? 

KE 
KG 
KP 

KR 
KZ 
UC 

u 

LK 



Spain 
Finland 
Fiance 
Gabon 

United Kingdom 

Georgia 

Ghana 

Gtunca 

Greece 

Hungary 

liciind 

lane) 

Iceland 

Italy 

Jai»n 

Kenya 

Kyi^yiatan 

DcmoctBlicPeopte'a 

((epubi'tcof Kojea 

{^fpubttc of Korea 

Kazakstan 

Sabc Loda 

Uedteasteis 

Sril-**a 

Liberia 



LS 
VT 
LU 
LV 

MC 

MD 

MG 

MK 

ML 

MN 

MR 

MW 

MX 

NE 

NL 

NO 

NZ 

PL 

FT 

RO 

RU 

SD 

SE 

SG 



Lesotho 

Uthuania 

Luxembourg 

Latvia 

Monaco 

Republic of MoWova 
Madagasear 

•me fonncr YugosUv 
Rcpoblic of Macedonia 
Mali 

Mongolia 

Mauritania 

Malawi 

Mexico 

Niger 

Netherlands 
Norway 
New Zealand 
Poland 

Portugal 

Komania 

Russian Fcdciaiion 

Sudan 

Sweden 

Singapoie 



SI Slorenia 
SK Slovakia 
SJ4 Senegal 

Swaziland 
TD Chad 
TG Togo 
TJ Tapkistan 

Twtanentstan 

TR 

rr Trinidad and Tobago 
UA Otoaine 

US United States of Amcnca 
UZ Uzbdcifiian 
Vid Nam 

YU Yugoslavia 

%y( Zimbabwe 



wo 00/31964 



1 



PCT/SE99/02106 



A METHOD «n> A DEVICE FOR EHCEVPTIOH OP I«*OES 

^CHNIOL ^ ana a device for 

The present xnvention reiaces 

encrypting images. 

3^0™. OP ~I ...c. ^co^s 

ix^ortant wn available to a user payxng for 

information whxcn only snaxx ij<= . ^ 

^ i-^«n Thus several methods for encrypting dxgxtal 
the information. Thus, sevexa i^^i-ie^d also 

data are in frequent use. Such methods can also be applxed also 
tHigltal i.agrdata. Examples of encryption methods are DBS, 
triple DBS and the public-key RSA method. 

teleco»mmic«tion network as digital "^9= ^ 
^ .istr««ted using a ^''VSica^ s-age J^^^^^^^ 

service P^-nrx'^rt^s c ^e.: -"ig^t ^ suitable to 
their busxness model. In tnx ^^^^^^ 

offer partial access to one set „,3^ be 

T>iTis some of tne xmage w^at-c* 
Tc^LrLlrrto :::;nt a. .sera .ro. ^ving .ui. access 
to all image data. 

be offered for sale on the Internet, 
.ews Photographs c- e^ ^^^^ ^^^^^^^^^ , 

The service provider wan ^,^1 itv for evaluation, 

version of. the image with reduced ^-^^J^^ ^ and 

vva*- want to publish an image, pay tor^ 
journals, that want to p quality image, 

are then allowed to download a full quality 

..-ider wants to minimize storage space 
However, sue. a service prov^er ^^^^ ,,„_.,.ely 

and download bit rates, sn image p cD-ROMs are given 

to distribute images on e^^ ^^^^ ^^^^^ a 

away or sold for a low P"^^^ ^.^„i„g them at full 

.educed gualitv but t^^- P^J^^^ ....age 

rprin rr^as efficiently as possible. 

SUBSTTTUTE SHEET (RULE 26) 
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It is »lso essential that customers always can access 
usi^g user friendly, standardised software . x^ge prov^ers are 
reluctant to design and support special in>age vxewers and 
customers don't want a proliferation of viewing tools. 

presently, i»age providers have to store two -rsions of th« 
l^ges stored. The full quality version .s stored as =^ 
encrypted in-age file. This that the i»age first « 

:::^essed an* stored in. a con^ressed file for^t such as^EO 
IHir The co.,pressed file is then encrypted using a suitable 
"elcr^tiln tooTand an encrypted i-age file i= 
^^first decrypt this file and then access 
con«.ressed image file usi^g an Wge vxewxng tool Reduced 
guSity images are produced by processing the full gualxty ^ 
^,:s in 1 image editing program. They are stored as separate 
compressed image files. 

The problems with this solution are that at least "° ^^^""^ 

*-y>^ case a customer first wanes to 
remote access m the case a 3^ resolution 

low resolution image before payxng for the full 

version. 

a sicmif leant disadvantage if the reduced 
This results xn a ^^^^^^^ ,l,e image 

version image contaxus a large frac^ ^^^^ journals would 

information. Images ° ^^^^^ ^ fairly good quality 

- P-i-ar - ^^^^^^ ^derstanding of 

since journal editors wan , . hiahest quality for 

the image content and accepts only ^^'Jf^/ the 
printing. The reduced quality image could regui 
storage space cf the full quality image. 

which la descrio .^^^ includes many new 

r.'rrr:: =r - . 
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can select a suitable progression raode. Individual objects 
ZZ is^S^s can be accessed separately in t.e .PKC .00 

\,H r^T-oaressive transmission can be applied also to 

xrr.^ ... ^^^^^^ 

decodable coding units. 

"L Object Of the present inveation to overcome the 
p..ble»s as outlined above and in particular to 
Lunt of nemory required for storing an ix»age. wluch P^rtxal^ 
be possible to view, and also to reduce transmission time 

Z a transmission scheme transmitting partially encrypted. 

ixoages- 

i^-^rprorr::-: rr^sfonVf^rrrrer/ifst 

ffrsfr^^-^"^^^ 
rrterr :::;e^a »r rtion ofthe ima. fi. is 

encrypted. 



ThuSr 



users -n,;o=es-o ^^1^::^^^ - 

t—erstc--- L — tLTrsrtr 

^,e. ^e storage ^--^J^l^r^rrs 'the storage, space 
^^"'"VrrTtLrng trrnt'rypted full c^ity i-^e. The 

.he image can also be ^^^^^^T' 
each section ^y be e-n.«/^ " ^encrypted, 

method and Keyword. ^-^/^^^^ ^ as described 

^ important element of the method ^ 
, herein is that the compressed images =o . ^ 

independently decodable coding units ( • ^^^^^^^^^ 

possible to perform encryption »P«"-°^= 
domain without performing entropy decoding. 

SUBSrmnE SHEET (RUl£ 26) 
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* reduced quality i^ge be produced according to several, 
dilferent main sciemes, such as. 

1) Reduced resolution ' . . ^ 

2) Reduced accuracy of tbe transform coeff^c:Lents^^ 
3, Bxclu^ion Of predefined regions of interest (ROD 

^e methods can be combined so tbat a reduced '^^^^iJ^Zy'^ 
Vg. produced by reducing both the resolution and the accuracy 
of the transform coefficients. 

By using the method and device for storing and transmitting 
iLg^^ta as described herein, several advantages are obta^ed. 
^ there is no need to store two different versions of an 

tnifferent users are to have access to different quality 
If different use „3^ssion times become much 

of the one and same rmage. Also tran ^solution, 
lower if the information content of ^^"^ resolution 
i^ge data can be reused when transmitting the higher 

image data- 

TprrenTi:^-"^^^^ ^"cribed in detail and 

I^th reference to the accompanying drawings, m which. 

* 4-v,<» <=Tle structure of an image. 
- Pig. 1 is a general view. of the ^ according to 

. Pigs. 2a and 2b shows encryption of images coa 

ri^rhLt mustratlng some steps carried out 

"Tig^^ITstlirgriTIIlustrating a client server process. 
: Pig. 5 is a view of an encryption header 

DETAILED DESCRIPTION ^ structure of an original, 

in Pig. 1. a general view of the fi ,^g,^„a file 

high resolution. ^^^^/^J^t^^^^Td^pendently decodable coding 
consists of a nu:nber of <i^«^"^^ £Ue structure shown in Fig • 
sections 101, 10. ^\tow /etolution version of a high 

.he --^""ft/^cltd Without encryption and will therefore 
resolution image, is coa« 
t>e possible to decode by any receiver. 
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• which combined with the 

-pv,^ c*.ction 103, which comprises data, waxen c 
The ' „ in a medimi resolution version of 

data of section 101, result i 3^ encryption 

section 103 • 

• wliich coiobined with tiie 

TtaT^s cti^'x- L. X03 results in a full .e.oX.ticn version 
t^ thl hlgh resolution i^ge. ' is encrypted using a second 
:Lr^tio! n.et.>od. and only receivers having access to t.e 
X^tion .ey will ^ able to decode the data stored .n the 
section 105- 

^„s. decoding o. the section - ^ ^^^^^ ^ 

r: "ht ::^ronT«f-r ^ur.i:: z -a 

decoding of the section ^„ a full resolution image 

from the sections 101 and 103 result m a full 



115. 



^ther^re. i^le:.entation - ^^^^ -^rrir^-n 

- - ^t: :rrir :::h coding u^t o. the 

roMtrel^ca^ reinserted in the hitstrea. so that a «rde 
Ze ot progressive »odes can he supported. 

A^-i 1 0 a coding unit is a part of 
^ ,,B3 .000 -'^"^""^^ttteclf^c hitplale of a given 
the hitstrea» ^^^^^'^J^l^Zl can he descrihed as any 
suhband. in general, a coding i^j^^ation. The general 

^.ependentlV ^^^^^^r lit™ order is .o include, so 
^chanism ^^^^ next coding unit (it is 

are needed £or Inserting explicit tags. 
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I, Pigs 2a and 2b bloclc. diagrams des«ibix>a how encryption can 
be i>.s>le»ented in tbe JPEG 2000 encoder and decoder 
respectively, are shown. 

Tims in Fig 2a a block diagram where encryption is performed 
2^ ; ™ coding in the encoder is shown. Coding ^ts^er 
1 entropy coding hlocK 201. In the block 201 cod^g the co^g 
^its are entropy coded using some suitable -""^^ =°f^^f ^ 
output from the block 201 is. fed to a selector which selects a 
::^'table encryption :^thod for each entropy coded c°d^- 
some coding unit, can be selected to not be encrypted at all. 

in response to the selection n^de in the selector 203 the 
^t^p^ coded coding units are encrypted in a block 20S. ^ 
Screed coding units together with the not encrypted codong 
^^then form a combined output data stream, whxch can be 
Stored or traixsmitted . 

• ^ decoder for decoding the bit stream generated by 

In Fig. 2b a decoaer toi. = encrvpted and not 

J - pscf 2a is shovm. Thus, fxrst encrypu 
the encoder xn Fxg. 2a xs ^^^^^ via a selector 251. 

rrs::e:::?srtrercr;p^irrhod for each entropy 
ZZ -it, or if the ^-eived coding unit .s not 

encrypted it is directly transmitted to a block 

in response to the selection made in the --J-J^^^rusing a 
entropy coded coding unxts are ^"^'^^^ 

..itable ^Tss t"trbrocr2SS the coding units 

then fed to the block 255. i decryption 
.,om fed directly from the -/^"^ . combined 

block 253 are entropy /""^^"^.Jstream which is fed 

output data stream corresponding to the data 

to the entropy coding block 201 m Frg. 2a. 

.,ch coding - ~ri:crntt; :::;redtiock. 

Pigs. 2a and 2b is ''-f f ^/J^^,/, ,epa,.tely with any user 
Bach coding unit can also be enc^ 

rrerr;rd^:"rd:^er::t encryption methods, .he 

SUBSTITUTE SHEET (RUUE 25) 
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encrvption me^a used can t^r be an -^^'^"^^i^"^"'" 
:;^ed with a keyword or a :nethod for generates .keywords . 

n«ferent encryption methods can in such an einbodiment have 

ra::ra: a..:St^ .^t di«erent ---^ --;-rtta 

T^«erit>tion (EMD) as shown in Figs. 2a and 2b is any gxo 
::rars:Lion Keywords or al.orith. identifiers 

specify the Encryption Method, nnit Encryption State TOES) ra 
a sy^ol that for each coding unit defines how it xs encrypted. 

in Fig 3, a flow chart illustrating different steps carried out 
delineating an i^ga are shown. First, in a step 301, an 
I^e^I^ >a^tially encrypted is received. The i^ge recerved 
rftep 3^1 is then coded using a coding algorithm generat^g 
^:;Llly decodahXe coding units, e.g. a.EO aooo, ^ a step 



303. 



. ,t«t. 305 some of the coding units of the image coded 
Next, xn a step 305, some table encryption method. 

■am fl-re encrvpted using some suitable encryyu 
in step 303 are encryp to be encrypted 

TM?e ThP codincx units that are ciiuo^* 
such as DES. The coamg ™<=preiices Thus, a user can 

.an he set in . higher order 

Chose to have cod^g un." ^"^J^ ,c,i„g units 

..t-planes etc^^cr^-^-^-^^V^^ are merged into . 

and the coding units wnicn ax 
single bit stream. 

.n ng. . a flow Chart ---^Hrrdi^ ml^I^ 
^ transmitting an i-SV^-f/ H/IL. Thus, a client 
.escribed in l^^^^^^ZX^ ^o'.' client .01 can then issue 
,01 is ---"^ ;trver 403 for a particular image, step 

a request towards the seirve 



405. 



403 replies by transmitting the coding units of the 
The server 403 replies y encrypted 
^ge Which are no^ en=^«-. ^^J^^^^^^ _ .ave 
coding units can be decoded y ^^^^ 
access to a low --^""""'"^fj^ay „ish to have access t 
Based on this information J^^^i ^^ge. If so the 

the image in a higher resolution or the 

SUBSmUTE SHEET (BULE 26) 
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client transmits a request to the server requesting such 
information, step 409. 

The server replies by sending a request to the client requesting 
the client to agree to the conditions for transmitting the ^ 
higher resolution version of the image, step 411. If the clxent 
agrees via a message 413, e.g. comprising a card number or 
account number from which to bill the cost for the image, the 
server sends the encrypted coding units together with a key word 
by means of which the encrypted coding units can be decrypted, 
step 415. A secure method for key distribution should be used. 
Examples of such secure methods are described in W. Stallings 

-Data and computer Communications", p 635 -637. Prentice-Hall 

1997 fifth edition ISBN 0-13-571274-2. 

If the client already has access to the unencrypted and ^ 
encrypted coding units, for example if he has purchased a CD-ROM 
rt^images coded as described herein. The scheme • as descried 
in conjunction can be modified so that no image data xs 
™ltted. instead the client only agrees to conditxons set by 
transmittea. word Is) which are 

the server in order to have access to the key word,, 
required to decrypt.the encrypted coding unxts o£ the CD ROM. 

xn the case when the method a^ device as d^scrihed herein^is 

used When encoding ^^'^--^-l^Z ^standardise 
is advantageous if the JPEG 2 000 included in the 

--'^zrrr^.zxTz^z »^ed with 

xmage header or opcio y snecify how coding 

the JPEG 2000 Tags can instead be used to specify n 

;anits are decrypted. 

in such an embodiment the OFBG 2000 in«ge header contains an 
in such an ^^^.^^ 

Encryption Flag (EF) . EF appended to 

encrypted. ^ ^^^I'^^J;^^^ ^J^l.^ information can 
the JPEG 2000 image header and encryp 
optionally be merged into JPEG 2000 Tags. 

^Mon header is shown. The Encryption Header 
ran^S^rreTorenrcontain the .Uowing symhois . 

SUBSTITUTE SHEET (RULE 25) 



PCT/SE99/02106 

WO 00/31964 

1) Encryption Mode (EM) . A set of standard encryption modes are 
defined e.g. 

a) one encryption, method is used for all coding units 

b) Bitplanes of less significance than bitplane X are encrypted 

c) Subbands of higher resolution than Y are encrypted 

d) ROIs specified in are encrypted, etc. 

NO encryption information need to included in the Tags if an EM 
is defined. 

2) Encryption Mode Parameters (EMP) . Parameters (X. Y. ...) that 
are used to define the Encryption Mode are set here. 

3) Number of encryption methods used. Several encryption methods 
can be used within the same image if e.g. different user groups 
should be allowed to see different image content. 

4) one Encryption Method Descriptor (EMD) for each encryption 
method. The EMD defines any data that is needed by the 

Is defined. A typical use o£ EMD will be to ,„ppiies a 

that is encrypted by a pv*Uc key algorithm. The user PP 

rrc-C.:- . Jorder o. ^^^^^ ^-^^ ^ 

. ^f-v,^^ This number is used an UEb syrouw-'- 
each encryption method. This numc 

S> ..e bitstrea. must .or ;;f^l^l:^^X"J'^^^^ 

anxt collected in the encryption header or 

3^13 could ^„ as encryption 

t ox^'on is Kept in the encryption header ve 
tags. If the yt,t> i"^" e-^t-o (vs) ES consists of 

define a header element - -^^^^^^^ '/J ,1 ,,,er as the 

a series of UES symbols that are listed m the sam 
coding units appears in the bit stream. 

^ c4-at-^^ is not given in the 
IF EF is set and the Encryption State is no 

SUBSTTTUTE SHEET (RULE 26) 
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unit • 

"electing appropriate ceding units belong^g to tbe ROI 
encryption- 

. ♦.v,»i- hhe shaDe of the ROI might reveal the 
The main problem xs that the sh^e o ^iffidt 
content. If the shapes are encrypted xt xs. ' 
to show a reduced quality image since .t .s dxf f .cult to 
interpret the coded transform coefficients. 

n«n be solved by defining a so called cloaking 
.^is 3^,e of one or several ROXs are 

shape ^--^^-[' J^'^^ The c-shape is designed to 

rnritellee contit. . simple example of a c- . 
shape is a bounding box. 

. -1 TariT in the JPEG 2000 bit 
. c-shape is -y^tir r^y^:^ as described in 

stream. The c-shape -^^f ^^^^^^^ ,,,, Verification Model 

Charilaos ^^^^^°P°""°%l"thl' technique as described therein 
version 2.0. According to the te^ qu ^^^^ 

this would result xn that the snap 



header. 



. ■r.r. the C-shape and the transform 
^ .asK is created ^J^^ J ^ J ,^ ,,,ed and encrypted 

coefficients belongxng to the c P ^^^^^^ 
using the method as descrxbed ^^^^ 3hielded 

.XI coefficients ^ f^,,,, .OIs is thus 

by the c-shape are encrypted. The tex 
protected by encryption. 

X.e s..e . ^Z:Z:;^^^^^^^ 
encryption header. The "^''^ corresponding c-shape. 

,.n.s encrvpte^- rrncrvpted .ac.ground. .he c 

The decoder can now 

SUBSTTTUTE SHEET (RULE 25) 
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V. ^^««laved as a blank region. The original ROIs can 
^"^r Td if tS Ke^ord is 3cnown. r^s is done .y decrypting 

done in the coin>ressed domam. 

that is used for encoding a ROI is not uniquely defined 
:^s. tl^t is sufficiently lar.e so 

Z loded lossless will often ^ -^^d" iTos re^-^ ■ 
=v i-hat is not allowed to expand will lead to a xo y 

Z ^s>.s ^longing to different ROIs or to a ROI 
1 "e^o^ground can designed to overlap. T^s .eans t>.t 

sone coefficients are encoded in -^^l^^^sZ' ROIs 

.-in t-n a reduced overall compression cuu 

cerlap wxll lead to a redu ^ ^^^^^^^^ ^^^^^^ 

are more independent so that any xux 
with a good visual res\ilt- 

^v. ^ *«-r WOTS described herein is not 
The partial encryption is selected 

dependent of the *oxce of «aa.^ 1°J^^^^^^^^^^^^ ^^^^ 

.ing the .ethod ^ ^ 
handwidth '"^^;^^^nlUd co^sition and processing of 

reduced, i^^ther™cre, f^^^^ ^ ^0,3 ,3, encrypted. 

encrypted =f ^^^"^^rc^Te -crypted and the original 
re;ttanr:e::y:trd and restored in the co^ressed do^arn. 

.other advantage is '^:^:Z:t:::'^' 
performed at the seine t^e (at the 

.he process taXes place rn the^c ^^^^^ 
bitstream syntax) it i P farmed Just before 

encryption. The ,„anscoder, . In this case, 

transmitting the image by a parser 

SUBSimJTE SHEET (RULE 26) 
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h7hTate which will be the case 
if the encryption ^^3^' ^ increase in bitrate 

if the encryption is placed xn the TAGS, the x 
is avoided and the encryption informatxon xs only added 
transmitting it- 
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CLAiMS 

1. i method cf partially encrretins i-age data co^istag tl» 

1-9= ^ta usi^g an encoding algorit^ generating 
inaepena«>tly decodable coding units, 

-!Lmtina at least one of the coding mats, and 
: units wMcn are not encrypted wltn coding un.ts 

which are encrypted into a coBi.ined bitstrean. 

. .«>od according to claim 1, characterised in that the not 
'^^Z l^Z l^^ correspond to a low resolution version o. 

•the image data, 
metiiods • 

. .tnod ecccrdi.^0 ^ -J- '^^^^ 

that an enoryptxon flag, »nic» 
encrypted, is inserted in the b.t stream. 

, • • ^ -I A when information 
5 ^ method according to any of clauas 1- 4. when 
5. A metiiw ^Tii-&r-est is encrypted ^ 

enclosed in a cloaking shape. 

. . device .or partial encryption o. image data characterised 

r^leans .or coding ^ 1!::^^^^^^^ 
!rr:o'n::^:r:: rC::, m^ans .r encryptmg . .est 
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